Goto

Collaborating Authors

 vocal production


Dirichlet process mixture model based on topologically augmented signal representation for clustering infant vocalizations

arXiv.org Machine Learning

Based on audio recordings made once a month during the first 12 months of a child's life, we propose a new method for clustering this set of vocalizations. We use a topologically augmented representation of the vocalizations, employing two persistence diagrams for each vocalization: one computed on the surface of its spectrogram and one on the Takens' embeddings of the vocalization. A synthetic persistent variable is derived for each diagram and added to the MFCCs (Mel-frequency cepstral coefficients). Using this representation, we fit a non-parametric Bayesian mixture model with a Dirichlet process prior to model the number of components. This procedure leads to a novel data-driven categorization of vocal productions. Our findings reveal the presence of 8 clusters of vocalizations, allowing us to compare their temporal distribution and acoustic profiles in the first 12 months of life.


Detection and classification of vocal productions in large scale audio recordings

arXiv.org Artificial Intelligence

We propose an automatic data processing pipeline to extract vocal productions from large-scale natural audio recordings and classify these vocal productions. The pipeline is based on a deep neural network and adresses both issues simultaneously. Though a series of computationel steps (windowing, creation of a noise class, data augmentation, re-sampling, transfer learning, Bayesian optimisation), it automatically trains a neural network without requiring a large sample of labeled data and important computing resources. Our end-to-end methodology can handle noisy recordings made under different recording conditions. We test it on two different natural audio data sets, one from a group of Guinea baboons recorded from a primate research center and one from human babies recorded at home. The pipeline trains a model on 72 and 77 minutes of labeled audio recordings, with an accuracy of 94.58% and 99.76%. It is then used to process 443 and 174 hours of natural continuous recordings and it creates two new databases of 38.8 and 35.2 hours, respectively. We discuss the strengths and limitations of this approach that can be applied to any massive audio recording.


Bats can learn to copy sounds and it may teach us about human speech

New Scientist

Bats can learn to mimic specific sounds, which puts them into an elite group of animals capable of this. Studying how bats can copy noises could help us learn more about humans' unique capacity for speech and language. The ability to imitate specific sounds – called vocal production learning – is rare in the animal kingdom. Humans are capable of it, as are some bird species, as well as seals, dolphins, whales and elephants. "It's relatively difficult," says Ella Lattenkamp at the Max Planck Institute for Psycholinguistics in Nijmegen, the Netherlands.